Large Deviation Methods for Approximate Probabilistic Inference
نویسندگان
چکیده
We study two-layer belief networks of binary random variables in which the conditional probabilities Pr[childjparents] depend monotonically on weighted sums of the parents. In large networks where exact probabilistic inference is intractable, we show how to compute upper and lower bounds on many probabilities of interest. In particular, using methods from large deviation theory, we derive rigorous bounds on marginal probabilities such as Pr[children] and prove rates of convergence for the accuracy of our bounds as a function of network size. Our results apply to networks with generic transfer function parameterizations of the conditional probability tables, such as sigmoid and noisy-OR. They also explicitly illustrate the types of averaging behavior that can simplify the problem of inference in large networks.
منابع مشابه
Inference in Multilayer Networks via Large Deviation Bounds
VIa We study probabilistic inference in large, layered Bayesian networks represented as directed acyclic graphs. We show that the intractability of exact inference in such networks does not preclude their effective use. We give algorithms for approximate probabilistic inference that exploit averaging phenomena occurring at nodes with large numbers of parents . We show that these algorithms comp...
متن کاملVariational Probabilistic Inference and the Qmr-dt Database
We describe a variational approximation method for eecient inference in large-scale probabilistic models. Variational methods are deterministic procedures that provide approximations to marginal and conditional probabilities of interest. They provide alternatives to approximate inference methods based on stochastic sampling or search. We describe a variational approach to the problem of diagnos...
متن کاملVariational Probabilistic Inference and the QMR - DTNetworkTommi
We describe a variational approximation method for eecient inference in large-scale probabilistic models. Variational methods are deterministic procedures that provide approximations to marginal and conditional probabilities of interest. They provide alternatives to approximate inference methods based on stochastic sampling or search. We describe a variational approach to the problem of diagnos...
متن کاملVariational probabilistic inference and the QMR - DT databaseTommi
We describe a variational approximation method for eecient inference in large-scale probabilistic models. Variational methods are deterministic procedures that provide approximations to marginal and conditional probabilities of interest. They provide alternatives to approximate inference methods based on stochastic sampling or search. We describe a variational approach to the problem of diagnos...
متن کاملVariational Approximations in a Broad and Detailed Probabilistic Model for Medical Diagnosis
Exact inference in large, detailed probabilistic models for medical diagnosis is typically computationally infeasible, and approximate schemes are therefore of great importance. In this paper, we consider variational methods, which provide bounds on the probabilities of interest. We sketch some characteristics of a typical broad and detailed probabilistic model (BDPM) for medical diagnosis and ...
متن کامل